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APPS Processing Steps 



inputs: DFS and^ Zfi2< 
audio file i 



30*1 



call Audio Feature Extraction 
to produce the Graphical 
Representation, given the 
audio file and the DFS 




3ou 



call Audio Feature 
Extraction to produce the 
markers requested in the 
DFS, given the audio file 
and the DFS 



no 








add marker data to DFS 




4 : 


1 i 




f 




call Audio Paper Formatting to 
produce the document type 

specified in DFS[output 
format] given DFS[layout *] 
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Audio Paper Formatting module 



input: APFS including the result- 
of feature extraction 



Hot 



1 



for each page in Layout[ pages ] 




■> return 



format meta data in APFS as specified 
in Layout[ meta data placement] 



1 



format APFS [Graphical Representation] 
as specified in Layout[type] given the 
result of Audio Feature Extraction 



I 



generate bar codes as specified in Marker 
type, Marker frequency, and Marker n 
fields in the APFS 



T 



format markers as specified in the APFS 
given the bar codes 



Hto 



render the page given the formatted meta 
data, Graphical Representation, and 
markers 



I 
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Bar code generation 



inputs: 



bar code type (e.g., Interleaved 2 of 5), 
no. of Identifier digits in bar code, 
no. of time stamp digits in bar code, 
time stamp value 

L_ 



read Identifier field from APFS 

I 



5ot 



convert Identifier to right-justified decimal string 



length (right-justified 
Identifier) > no. of 

Identifier digits 
allowed in bar code^ 



yes 



return 
error code 



no 








no 

r 








append right-justified time stamp (padded on the 
left with zeroes) to right-justified Identifier 




$10 




if 






render bar code image of specified type containing 
Identifier + time stamp 





return 
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Document Format Specification 

Type = Musical recording 
-Identifier = 1768 
Title = Locomotion 
\rtist = John Coltrane 
(oiO *C^>Collection = Blue Train 
^'x^V/^Publisher = Blue Note Records 
(pfl ^^^XyPublication Date = 1957 
i time = 00:00:00 
I time = 00:07:14 



Audio Feature Extraction 



Audio amplitude extraction and graphical . 
approximation. An svg file is outputr**— ^"U>0 U> 





aphical Representation = Amplitude curve' 

type = bar code : — - — ~(jtt 

Marker frequency = 30 sec. intervals — 

Layout type = One horizontal time line — 
layout pages = 1 

Layout marker placement = Above graphical representation— 0*3 fr 
Layout meta data placement = Centered at top of page 




Locomotion by John Coltrane 

on Blue Train ^ 
(c) 1957 Blue Note Records 



n- 



iii 




' 1 ' ' 000357 '" ' ' 00:07:14 
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Document Format Specification 



Audio Feature Extractio 



10 nC"- 



Audio amplitude extraction and graphical 
approximation. An svg file Is output. Musical 
Solo extraction is also applied. It outputs the 
beginning times and instrument for each 
musical solo. 




Type = Musical recording 
Identifier^ 1769 
Title = Locomotion 
Artist = John Coltrane 
Collection = Blue Train 
Publishers Blue Note Records 
Publication Date = 1957 
Begin time = 00:00:00 
End time = 00:07:14 

Graphical Representation = Amplitude curve 

Feature extraction = Musical solos (output is instrument name and time when solo began) 
arker typel = Instrument name above bar code above time stamp 
arker type 2 = bar code 
arker2 frequency ■ 0, 50%, 100% 
Layout type - One horizontal time line 

Layout pages = 1 -n <q 

Layout markerl placement = Above graphical representation^**^ ' lky 

Layout marker 2 placement - Below time line^- 

Layout meta data placement = Centered at top of page 



-ill 



lllf 




^Locomotion by John Coltrane 

on Blue Train 
(c) 1957 Blue Note Records 



Piano 
000*58 



Drums 
0o!o5*37 
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Document Format Specification 



Audio Feature Extraction 

Audio amplitude extraction and graphical- — (pOC* 
approximation. An svg file is output. 



Type = Radio program 
Identifier = 1770 
Title = Fresh Air with host Terry Gross 
-annotation = Guest Bill O'Reilly 
Publication Date = Oct. 8, 2003 
Begin time = 00:00:00 
End time = 00:40:45 

Graphical Representation = Amplitude curve 
Marker type = bar code 
Marker frequency = regularly spaced 
Layout type = One horizontal time line 
Layout pages - 1 

Layout marker placement = Above graphical representation, 3-step staircase 
Layout meta data placement = Centered at top of page 



Fresh Air with Host Terry Gross 
Wed. Oct. 8, 2003 
Guest Bill O'Reilly 
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Document Format Specification 

Type = Radio program . 
Identifiers 1771. 

Title = Fresh Air with host Terry Gross " 
annotation = Guest Bill O'Reilly 
Publication Date « Oct 8, 2003 
Begin time = 00:00:00 
End time = 00:40:45 

Graphical Representation = Amplitude curve 

arker type = keywords, bar code, time stamp 
Marker placement = above time line 
arker frequency = user-defined 

"arker 1 = (WTC, barcode, 04:28, vert pos. 1) 
■Marker 2 = (NY Times, bar code, 09:08, vert. pos. 2) 
arker 3 = (Peabody, bar code, 12:30, vert. pos. 3) 

arker 11 = (People Mag, barcode, 39:10, vert. pos. 3) 
Layout type = One horizontal time line 
Layout pages = 1 

Layout marker placement = Above graphical representation, as provided 
Layout meta data placement ■ Centered at top of page 



Audio Feature Extraction ^""^0 L» 

Audio amplitude extraction and graphical 
approximation. An svg file is output. 




HPresh Air with Host Terry G ross 

Wed. Oct. 8, 2003 
Guest Bill O'Reilly 



Sc'cularisl 



Zone 



Al Franhon 



^"20" Unfair f^^WiO 



Ilntcrriev 
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Document Format Specification 

Type = Radio program 
Identifiers 1772 



Audio Feature Extraction ^"T^ 

Audio amplitude extraction and graphical 

approximation. An svg file is output. 
Speech recognition is also applied followed by 
matching to a given list of phrases. 



Title = Fresh Air with host Terry Gross 
Annotation ■ Guest Bill O'Reilly 

keyword search terms = "New York Times' and 
'fair and balanced" 

Publication Date = Oct. 8, 2003 
Begin time = 00:00:00 
End time = 00:40:45 
■ Graphical Representation ■ Amplitude curve 

Id eature extraction = speech recognition and keyword match to "New York Times" or "fair and balanced 
^--Marker type = matching search term, bar code, time stamp 
Marker placement = above time line 
^Marker frequency = user-defined 

darker 1 = ("fair and balanced", bar code, 02:31 , vert pos. 2) 
Marker 2 = ("New York Times", bar code, 04:21, vert. pos. 1) 
Marker 3 * ("New York Times", bar code, 14:54, vert. pos. 2) 

Marker 9 = ("New York Times", barcode, 35:12, vert. pos. 3) 
Layout type = One horizontal time line 
Layout pages = 1 

Layout marker placement = Above graphical representation, as provided 
Layout meta data placement = Centered at top of page 




FlCr. I04. 



-no 




Fresh Air with Host Terry Gross 

Wed. Oct. 8,2003 
Guest Bill O'Reilly 
keyword search terms = "New York Times" and "fair and balanced" 



ilr and balan ced" 

'New York Titles" 




York Times" 

fair and balanced" 

""iS-iT' 
_l 



Tali. end balanced" 



"NewYcric Times" 
"22-oi"" 



"New York Times" 

"fair end balanced* 

New York Times" 
"33r0'l" , i" 
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^^~^)Document Format Specification 

Type = Radio program 
Identifier = 1773 



Audio Feature Extraction (/6 £, 

Audio amplitude extraction and graphical 
approximation. An svg file is output. 
Applause detection outputs time stamps. 



Title o A Prairie Home Companion 
Annotation = applause events shown 
Publication Date = Sun. Oct. 12, 2003 
Begin time » 00:00:00 
End time = 01:58:56 

Graphical Representation = Amplitude curve 
-Feature extraction = applause detection alpha=0.27 beta=1.86 
Marker type = time stamp, bar code 
Marker placement = above time line 
Marker frequency = user-defined 

Marker 1 = (00:02:1 3 t bar code, pos. 1 ) 

Marker 2 = (00:10:54, barcode, pos. 2) 

Marker 3 = (00:12:32, bar code, pos..3) 

Marker 16 = (01:56:01, bar code, pos. 2) 
Layout type = One horizontal time line 
Layout pages = 1 

Layout marker placement = Above graphical representation, as provided 
Layout meta data placement = Centered at top of page 



A Prairie Home Companion 

Sun. Oct. 12, 2003 



applause events shown (as infrequent as they might be) 



.0120:36 0 - 1 l £ l 2:4 'L 
01:29:01 

rr 
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Document Format Specification 

Type = Radio program 
Identifier^ 1774 

Title = A Prairie Home Companion 
Annotation = music events shown 
Publication Date = Sun. Oct. 12, 2003 
Begin time = 00:00:00 
End time « 01:58:56 

Graphical Representation = Amplitude curve 
^IKI — Feature extraction = music detection delta = 12.93 
i ou M arker type * time stamp, bar code 
M arker placement ■ right of time line 
Marker frequency = user-defined 

Marker 1 = (00:21:54, bar code, horiz. pos. 1) 
Marker 2 = (01:10:53, bar code, horiz. pos. 1) 
Marker 3 * (01:34:01, bar code, horiz. pos. 1) 
Marker 4 = (01:41:41, bar code, horiz. pos. 1) 
^Layout type * Two vertical time lines, split in half 
t*l\ Layout pages = 1 

\$> Layout marker placement = To right of gra 



Audio Feature Extraction^^ ^ 

Audio amplitude extraction and graphical 

approximation. An svg file is output. 
Music detection outputs time stamps. 



Layout meta data placement * 



right of graphical representation, as provided 
Centered at top of page 
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A Prairie Home Companion 

Sun. Oct. 12,2003 
music events shown 



01 :29:29 
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